A generalization of Clausius inequality for processes between nonequilibrium steady 

states in chemical reaction systems 
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We investigate nonequilibrium chemical reaction systems from the view point of steady state 
thermodynamics proposed by Oono and Paniconi [Prog. Theor. Phys. Suppl. 130, 29 (1998)]. The 
concentrations of some compounds are operated by an external system, so that a transition from a 
steady state to other steady state takes place. We show that an analogue of Clausius inequality holds 
macroscopically for the operation processes. This implies that the second law of thermodynamics 
can be generalized, including nonequilibrium steady states. 

PACS numbers: 05.70.Ln, 82.60.-s, 02.50.Ga 
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Most of the interesting and important chemical re- 
actions take place under nonequilibrium conditions, for 
instance, in biological systems and in chemical plants. 
When the concentration of a compound is changed by an 
external system, how do the concentrations of the other 
compounds respond? What kinds of restrictions are im- 
posed on possible physical processes? Beyond individual 
systems, if there is a phenomenological framework for 
nonequilibrium states to study such questions, it is as 
valuable as equilibrium thermodynamics. 

A lot of efforts have been done to describe nonequi- 
librium systems from thermodynamic viewpoints [Q. 
Oono and Paniconi have proposed a phenomenologi- 
cal framework, steady state thermodynamics (SST) []2|, 
for nonequilibrium steady states in a parallel form to 
equilibrium thermodynamics. A significant character- 
istic of equilibrium thermodynamics is the second law 
which asserts the existence of quasiequilibrium and non- 
quasiequilibrium processes, that is responsible for the 
evolution and stability criteria. Similarly, they con- 
sider that even for the processes between nonequilibrium 
steady states " quasisteady" and "non-quasisteady" pro- 
cesses should exist. Since the system steadily generates 
dissipations, we need to carefully extract a quantity rel- 
evant to the operation to change the steady state. For 
such a quantity, they propose the "excess heat" absorp- 
tion Q ex = Q — Qhk where Q is the heat absorbed by the 
system, and Qhk is the "house-keeping" heat absorption 
to maintain the steady state. In an appropriate "quasis- 
teady" limit, the quantity should be equal to the differ- 
ence of a pertinent "thermodynamic function" of SST. 

Whereas ultimate justification of the framework re- 
mains with its experimental analysis, it may be worth- 
while to explore several models for the validity of SST. 
Sekimoto and Oono studied a simple Langevin system 
so that they found the house-keeping heat and a ther- 
modynamic function for the system Q. Hatano found 
the minimum work principle for nonequilibrium steady 
states assuming a particular condition J. Then Hatano 
and Sasa investigated a Brownian particle driven by an 
external force Q. For a process operated by an exter- 
nal system, they found the generalized Jarzynski equal- 
ity Q, (explPQex + 4>{xf\a,f) - 4>{xi;ai)}) = 1 where 



4>{x; a) = \ogp(x; a) with p(x; a) the stationary probabil- 
ity of the steady state given a parameter a, at and a/ are 
the parameters of the initial and final state of the pro- 
cess, f3 is the inverse temperature, and (•) indicates the 
ensemble average over all possible paths. Then, identify- 
ing S(a) = —(<p{x,a)) — — f p(x;a)logp(x;a)dx as the 
entropy function of SST, they found generalized Clausius 
inequality /3Q ex < S(a,f) — S'(a i ). They also proposed 
that the house-keeping heat is related to the degree of 
breakdown of the detailed balance condition. 

In this Letter, we investigate nonequilibrium chemical 
reaction systems from the viewpoint of SST. We consider 
"ideal" reaction systems, i.e., the mixture and reactions 
are homogeneous in space, the non-reactive collisions of 
molecules occur frequently between the successive reac- 
tions, and the time scale of the reactions and that of 
the internal degrees of freedom of the molecules are sep- 
arated. Then the system can be described by Markov 
jump processes We show that the similar argument 
developed in Q also holds in such systems. First we show 
that a generalized Jarzynski equality holds for Markov 
jump processes. Connecting the equality with an ener- 
getic interpretation, we show a generalized Clausius in- 
equality, which is the manifestation of non-quasisteady 
processes. 

Consider a vessel with its volume V, in which (M + 
N) chemical compounds Aj (i = 1, • • • , M) and Xj (j = 
1, ■ • ■ , N) exist. Among these chemical compounds, the 
following chemical reactions take place: 
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with I = 1, ■ • ■ , L. Let us call the forward reactions re- 
action +1 while the backward reactions reaction — I. We 
assume that both the rate constants k + i and k_i of the 
reaction +1 and reaction —I, respectively, are positive. 
The stoichiometric coefficients c± u and c±ij are non- 
negative integer. The concentrations of A^'s are kept ai. 
The number of molecules Xj is denoted by nj. The 
state of the system is denoted by n — (jii,--- , njv)- 
Let v% be y\ u = -z/° y = c°_ ;j - c° +lj and v Xj be 
z/ + ;., = — i>-ij = c-ij — c+u. When the reaction I G 
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[-L, • ■ ■ , — 1, 1, ■ • ■ ,L] takes place, the state jumps from 
n to n+ vi = (ni + ifa, • • • ,n N + v lN ). 

For A^'s, one can consider that these compounds are 
exchanged between the vessel and its surroundings, and 
the exchange process is sufficiently fast so that the con- 
centrations are well controlled. Although we neglect to 
consider the exchange process for simplicity, it is always 
possible to take the process into account. We then con- 
sider the situation where an external system operates 
the system in time by changing some of the concentra- 
tions aj's during the times [0, i]. The set of such time- 
dependent concentrations at time s are denoted by a(s), 
and a(s) is changed according to a given operation pro- 
tocol a(s) <s<t- 

The probability p(n, s) that the system is in the state n 
at time s follows the master equation, 



dp(n, s) 
ds 



(E^-l)Wi(n,n + wj;o(s))p(n,a) (2) 



where E" 1 is an operator defined by its effect on an arbi- 
trary function /(n), E"'f(n) = /(m-i/ji, • • • ,n N -vi N ), 
and Wi [n, n + v^a) is the transition probability, given a, 
that the reaction I takes place per unit time fq] , 
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W l (n,n + u l ;a) = Vk l l[a^l[ 



njl/jrij - Cij)\ 



(3) 



with I G [— L, ■ ■ ■ , — 1, 1, • • • , L], We suppose that if 
the time-dependent parameters are virtually fixed at a, 
the probability distribution function approaches a unique 
stationary probability distribution function p s (n; a) that 

satisfies J2i=-l O^" 1 — -*-) n + v l'i a )Vs{n\ a) = 0. 

Let us consider a particular state at time s denoted 
by n(s), and a particular path denoted by n(s)o< s <t- 
Starting from an initial state n(0), n(s) is given by 



n,-(s) = n i (0) + 



L 
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vij£,i(u)du 



(4) 



where each £;(s) is a sequence of 5-function, located at 
those times when the reaction / takes place. 

For these processes, we consider an energetic interpre- 
tation. In the present model system, we simply suppose 
that a molecule of each compound has the energy Ef of 
Ai or Ej of Xj and no interaction energy among molecules 
is taken into account. Under equilibrium conditions, the 
states of the system should obey the grand canonical en- 
semble, and the detailed balance condition should hold. 
This leads to a relation between rates of a transition and 
its reverse, as 
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(5) 



where vq is a certain constant of the dimension of V . 



For a particular state n, the internal energy of the sys- 



tem £ is given by £ — X^=i E j n j- The internal energy 
change A£(t) is given by 



A£{t) = £{t) - £(0) 



N t L 
i = l J ° l = -L 



(6) 



Here the energy of A;'s is not included in £ for the follow- 
ing reason. Since in the present consideration the con- 
centrations of Ai's completely follow the parameters a,'s 
at every moment, the role of A^'s is nothing more than 
that of reservoirs. If one would consider this unphysical, 
the injection and extraction processes should be took into 
account. 

Next we show that the generalized Jarzynski equality, 
which shall be given in Eq.(p"3|), holds in the Markov jump 
processes generated according to Wi- The idea to prove 
the equality has been developed first by Crooks under 
equilibrium conditions JtJ] . Then, Hatano and Sasa gener- 
alize the argument for Langevin systems under nonequi- 
librium conditions ||. 

Consider that a particular path n(s)o< s <t, which is a 
sequence of states 



n(0) ^ n(ti) 



n(t n ), 



(7) 



with tj a jump time when the system jumps from n(Aj_i) 
to n(U) = n(tj_i) + (i = 1j • • • *n < * < t n+ i). 

If the system is in the state n at time s, the proba- 
bility that a transition takes place per unit time is given 
by W(n;a(s)) — Y1i=-l Wi{n, n + vi\ a(s)). The system 
stays in n until s' = s + r, where r is an independent ran- 
dom variable distributed according to the density func- 
tion W(n;a{s + r))exp{- f° +T W{n;a(u))d u y Then, 

at s' the system jumps to n + v\ according to the proba- 
bility Wi(n,n + ui;a(s'))/W(n;a(s')). 

Suppose that at time the system is in a steady state. 
Then, the probability V[t] = P[n(s) < s <u a(s) < s < t ] 
that we have the path n(s) < s <t is given by 



V[t] = p.(n(0);a(0))JJWi 4 (n(t i _i),n(t i );o(t < )) 

i=l 

xe -/„' W(n(u);a(u))du 



(8) 



where to = 0. 

Consider the transition probability Wi(n, n+vi; a), de- 
fined by 

Wi(n,n + vi;a) = ^ , + ^ W-i(n + v u n; a). (9) 
p s {n;a) 

If the detailed balance condition holds, Wj = W\. For 
a given path n(s)o< s <t generated by Wi, consider the 
path n(s) <e<t generated by Wi given by n(s) = n(t — s) 
with a parameter protocol a(s) = a(t — s). The jump 
times for n(s)o< s <t is given by tj = t — t„-i+i at 
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which the transition takes place from n(fj_i) to n(ti) = 
n(ti-i) + vr, with U = —In—i+i- The probability V[t] = 

V(n(s)o< s <t;a(t)o< s <t) that we have the path n(s)o< s < t 
is also calculated as is the case of V[t]. Here, we suppose 
that n(s) also starts from a steady state. Now we com- 
pare V[t] with V[t). Let us introduce the quantity <p(n; a), 



p s (n;a) = exp (j>(n;a) 



(10) 



Using Eq.(||), and noting W(n;a) — J2i=-l Wi(n, n + 
a) = W(n; a), V[t] has a density relative to V[t] as 

V[t] = e ^( n (*)>°(*))-^(«( )> a ( ))+*[*]p[il (11) 



where = &[n(s] 



0<s<t 



a{s) 



0<s<t_ 



is the quantity 



(n(a_ );o(s)) - 0(n(s);a(s)) k(«)ds (12 



$[t] 



with £(s) = J2i=-l £*( s ) an d n ( s -o) the state just before 
the jump to n(s) at time s, i.e., the state after the pre- 
vious jump event. By summing Eq.([LT|) over all possible 
paths, we obtain the generalized Jarzynski equality 

(exp {0(n(t), o(t)) - 0(n(O), o(0)) + = 1 (13) 

with Eqs.(|Io|) and (fl2]), where (■) indicates the ensemble 
average over all possible paths. 

It may be worth mentioning that if one consider that 
the path n(s)o< s <t is generated according to Wi instead 
of Wi , the fluctuation theorem is obtained by comparing 
the path probabilities J^, ||] . 

Eq.(n3|) leads to the relation 



m])<-m))-(-(m)), 



(14) 



where -((f>(s)) = - X) n p s (ra; a(s)) log {p s (ra; a(s))}. 
When the change of a(s) is so slow that p(n, s) can be 
regarded as p s (n] a(s)), the equality holds in Eq . (O) . 

Next we interpret the inequality ( fTi] ) from energetic 
point of view and show the existence of non-quasisteady 
processes. Let Q(n, n + vi;a) be the quantity that charac- 
terize the degree of the breakdown of the detailed balance 
condition, given by 



p s (n, a)Wi(n,n + Uf,a) 
p s (n + vi,a)W-i(n + vi,n; a) 



(15) 



Obviously, if the detailed balance condition holds, 
Ci(n,n + vi;a) = 0. Substituting Eqs.(§), (§) and © 
into Eq.(H), $[t] can be rewritten by 



t L M 
l = -L i=l 



t L 



(i{n(s) - vi,n(s);a(s))£i(s)ds 



l = -L 
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nj{s)\ 



£i{s)ds (16) 



with /x°(s) = Ef + jj log {vocii(s)}, the chemical potential 
of Ai. For the first three terms on the r.h.s., we introduce 
the quantity V ex [t] = V ex [n(s) <u a(s) <t] given by 

t L M 

V ex [t] = A£{t) + ^^4?( S )a( S )<i S -%[t], (17) 

J° l=-Li=\ 

where I>wt[t] = V hk [n(s) < s < t ; a{s)o< s <t] is define by 



M = 4 / E Cl(n(«) " vi,n(*);a(«))6(a)d8. (18) 



Note that the fourth term on the r.h.s. of Eq.(|l6|) is 
rewritten by tog{n|Li (^) %(s) nj(s)\} |^*. Substitut- 
ing Eq.© into Eq.©, with Eqs.@ and ©, we ob- 
tain the main result of this Letter 

p{T>ex[t]) < 5(o(t)) - 5(o(0)), (19) 

where S(a) is the quantity define by 

s( a ) - -Ep s (^;a)iog{n(y)"^ ! ^( n ; a )}- ( 2 °) 

n i ^ 

In order to make T> ex [t] in ( pT[ ) transparent, we introduce 
Ai the chemical affinity of the reaction I as 

M N 

A = -E^i = -^l ( 21 ) 

with /ij(s) the chemical potential of Xj. When .A; > 0, 
the reaction I proceeds on average. Under equilibrium 
conditions, Ai = 0. Using Eq.(||), T> ex [t] is rewritten by 

/■t 

V ex [t] = AS(t)- rVfijdn^s) 

J ° 3=1 

- / E Mi(s)ds-V hk [t}. (22) 
70 i=-l 

Let us first see the consistency between ([l9]) and equi- 
librium thermodynamics. Under equilibrium conditions 
T^hk[t] = and Ai — 0. Thus, the first two terms on the 
r.h.s of are relevant to equilibrium thermodynamics. 
By considering S(a) as the equilibrium thermodynamic 
entropy, (jis| ) is nothing but Clausius inequality. 

Under nonequilibrium conditions, the third term on 
the r.h.s. of fl22J) includes the continuous dissipation, even 
when system's parameters are kept constants. In order 
to discuss the thermodynamics with respect to operations 
upon the system, we need to carefully extract the quan- 
tities relevant to the change in the macroscopic state. 
When da/dt is so small that p(n,s) can be regarded as 
p s (n;a(s)), (D ex [t\) coincides with the difference of S(a) 
between the initial and final state of a process. Let us 
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then consider (V ex [i\) as the quantity relevant to the op- 
erations, and <S(a) as the thermodynamic function that 
characterize the nonequilibrium steady states. The qua- 
sisteady process is realized in the limit l/t — ► 0, given the 
parameter protocol a(s) — a(s/t) with a given parame- 
ter path a(r)o<r<i- When l/t is finite, (T> ex [i\) is smaller 
than the difference of S(a) and the processes are consid- 
ered to be non-quasisteady processes. In (|l7|), —(T>hk) is 
regarded as the dissipation called the house-keeping dis- 
sipation that keeps the system far from equilibrium 
In this way, we find a similar structure in nonequilibrium 
steady states to equilibrium thermodynamics, and con- 
sider Eq.([l9|) as a generalization of Clausius inequality. 

In the definition of the house-keeping dissipation Jig ) 
and hence the steady state entropy (|20| ) there is some 
arbitrariness. So far no systematic discussion exists 
in order to justify these definitions under nonequilib- 
rium conditions. However, in some cases we identify 
— (T>f l k[n(s)o<t\) as so-called entropy production. When 
p s (n; a) is a Poisson distribution or for each compound a 
grand canonical distribution can be supposed (local equi- 
librium), T>hk is written by 

- (2?hfc[n(«)o< t ]> - W £ Ml(s)ds\ (23) 

where (ij{s) in Ai is defined by /ij(s) = Ej + 
± log {v {nj(a(s)))/V} with (rij(a)) = £„ n,,p s (n; a). 
The r.h.s. of Eq.(j2^) is identified as the entropy produc- 
tion [Q. In such cases, although the condition is nonequi- 
librium, V ex can be reduced again as 

,t n 

V ex [t] = A£(t) - / yV-drij-OO, (24) 
so that the same form as in equilibrium thermodynamics 



is obtained. This implies that at least near equilibrium 
the same relation with equilibrium thermodynamics can 
be applicable to nonequilibrium system by extending the 
definition of entropy. 

If we compare the inequality fll9| ) with the previous 
result in ||, /3Q ex < S(a f ) - S(a,i) with Q ex = Q - Qhk, 
one might identify the first three terms on the r.h.s in (53) 
as the heat absorbed by the system. However, this is not 
the case, since in the present case the dissipation without 
heat generation can take place such as the mixing without 
energy conversion JToj ] - 

We note that if each molecule is described individu- 
ally, S is rewritten by S = - J2{ n } Ps{{n}) logp s ({n}), 
where p s ({n}) is the probability of the state {n} where 
the molecules are distinguished. 

In the present Letter, nonequilibrium chemical reac- 
tions have been studied from the view point of steady 
state thermodynamics [|| . First we have shown that the 
generalized Jarzynski equality holds in the Markov jump 
process, and then we have a generalization of Clausius 
inequality (|l9|). The argument presented here can be ap- 
plicable to other systems such as lattice gas systems. Our 
choice of the connection between the energetics and the 
kinetic parameters is quite simple. When the connection 
between them is much more complicated, how our result 
will be modified remains to be clarified. The experimen- 
tal verification of the present result is another significant 
problem. Especially, how the entropy function and the 
house-keeping dissipation can be measured remains as a 
future problem. 
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